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Abstract 

We propose a reconstruction of the initial system of ordinary differential equations from a 
single observed variable. The suggested approach is applied to a certain class of systems 
which includes, in particular, the Rossler system and other chaotic systems. We develop 
relations and a method to pass from a model that involves the observable and its time 
derivatives to a real original system. To this end, we first find a set of candidates of the 
system in an analytic way. After that, by additionally studying the system, we make a 
choice for the sought system. 
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1. Introduction 

The problem of reconstruction of a dynamical system from time series is topical in many 
fields of human activities. Various aspects and approaches to this problem have been treated 
in numerous studies. Most often, this problem is solved using numerical methods. For 
example, the authors in jjj have used a Legendre polynomial approximation of the vector field 
flow. The same flow method has been used in Q| to reconstruct maps or differential equations 
with hidden variables. Alternative algorithms have been proposed by many authors. In 0, 
0, [ij , the coefficients of the unknown system were sought for on the basis of a hierarchical 
approach. A two-stage Taylor series approach \0\ has been used in 0] to construct an effective 
algorithm. Also, an improved algorithm is proposed in jsj, where the optimization becomes 
more effective via a reduction of the initial parameter region. To achieve this, the author 
uses a cumulative backward differentiation formula. In order to improve the calculation 
algorithm, a perturbation method is used in ji| replacing the traditional Gauss-Newton or 
Levenberg-Marquardt methods. The mean square root method is used in jlOJ to find the 



coefficients in the Lorenz systems and the Chen systems |12[ for series with noises. 
H. Iba 13( has improved the mean square root method by using the genetic programming, 
which was also used in 1^, ll5|] . A simplification of the calculation algorithm was proposed 
in 16| by reducing the number of the sought system parameters using a known relation 
between them. Good reconstruction results can be obtained via the Bock algorithm 17. 18l . 



Email address: gorodetskyi@iee.kpi.ua; v.gorodetskyi@gmail.com (V. Gorodetskyi) 
Preprint submitted to Physics Letters A 



A probability approach to determine the coefficients of the equations, which generate the 
time series, has been used in [H| , and for forecasting of the time series without constructing 
the model in j2o|. In jlH, the equation coefficients were determined by comparing the type 
of the attractor, the first return map, and the largest Lyapunov exponent that were obtained 
from the original system and the proposed model. A synchronization method was used for 



obtaining a model by using vector time series in [22J. A similar approach was used in [231.124 



To forecast the time series, traditional reconstruction methods are widely used together with 



relatively new approaches, inclu ding neural networks [25[, radial basis functions [26|, fuzzy 
modeling [27|, wavelet networks [28j, etc. 

The reconstruction problem we will be dealing with consists in a structure selection for an 
autonomous differential system with a polynomial right-hand side from a single observable 



variable. From this point of view, the approach proposed in [29|, |30|, |31|, |32j is interesting. 



In [33j, the following questions arising in the problem of global reconstruction were formu- 
lated: (1) Is it possible to create a model, within a certain class of models, that describes 
the initial time series? (2) Is the model unique? If not, what is the degree of nonuniqueness 
within the class of models treated? Answering these questions in this reference, numerical 
methods were important, in particular, the genetic algorithm was used. 

In this paper, we will show that the structure of the model can be obtained for a certain 
class of systems in terms of mainly strict mathematical transformations with a minimal 
use of computational operations. In addition to the structure, this approach allows also to 
obtain relations between the coefficients of the sought equations, which brings the researcher 
closer to an ideal solution of the reconstruction problem, which is to find an exact model for 
the original system with a unique true choice for the coefficients. A procedure to solve the 
reconstruction problem could be as follows. 



1. Using a numerical procedure, construct a standard system [30| using the observable 
and its derivatives. 

2. Using analytic relations between the coefficients of the standard and the original sys- 
tems obtain a family of candidate systems [37| containing the original system. 

3. Using additional information (if this information suffices) choose a unique real original 
system from the family of candidate systems. 

4. If the additional information does not allow to make the choice, conduct an additional 
investigation. It is assumed that conditions of the experiment allow for conducting 
such an investigation. 

It can be seen from the given procedure that it contains only one typical numerical operation 
(item 1) that can be repeated if necessary. 

The paper is organized as follows. In Section [2J we consider a relatively simple class 
of systems that could have chaotic dynamics. For such a class, we deduce relations that 
could be used for reconstructing the unknown system from a single observable. Section 13.11 
contains examples where we apply these relations to find analogs of the Rossler system that 
would have the same observable as the original system. Sections 13.21 13.31 deal with finding, 
in a given class, all systems that can be the original system (items 1 and 2 of the above 
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procedure). In Section l3T4| we discuss choosing the original system from the set of candidate 
systems (items 3 and 4 from the above procedure). 



2. Essentials of the approach 



Consider a system 

where the variables x 
functions. Following [30 



Xi 



, x r 



i = l,...,n, define the state of the process, X t are polynomial 
we will call system ([T]) the Original System (OS). Assume we 



know one solution of (jTJ), a function Xi(t). Since, without any further information about 
system (PQ), it can not be recovered from data about only one observable Xj(t), system §Q is 
often replaced with a Standard System (SS), 



Hi 

in 



2/2, 
2/3, 



(2) 



Vn = Y(y h 



where y\{t) = X;(t), Y(yi, . . . , y n ) is often taken to be a polynomial or a rational function. 
Here, many properties of systems ([T]) and (T2J) are the same. 

It is clear that, in a general case, such a model can not give an exact realization of the 
physics of the process the way the OS does. Also, the function yi(t) obtained when system ([2]) 
is reconstructed could be approximately the same as the function Xi(t), yi(t) w Xj(t). At 
the same time, there are particular cases where Xi(t) and y\{t) coincide, that is, there is a 
system of type ([2]) such that yi(t), being its solution, satisfies the identity 



yi (t) = Xi(t). 



(3) 



Such an exact substitution can be performed if there exists an inverse standard transforma- 
tion (1ST) that connects the variables in ([!]) and (J2]) 29 . 



It is clear that numerical methods can be applied to a wider class of systems, however, 
it may be useful sometimes to use an analytic approach for finding the OS. The complexity 
of this approach depends, among other things, on the general form of the OS, namely, on 
the number of the variables and the form of the polynomials that enter the right-hand side 
of system ([1]). For example, even if the system contains three variables and the degree of 
the polynomials is two, the general form of system ([1]) can be fairly complex, 

' X\ =a + diX\ + 02^2 + 03^3 + a^x\ + 05^1X2 
+ 06X1X3 + CI7X2 + 08X2X3 + 09X3, 
i-2 =bo + hxi + b 2 X2 + hx 3 + b A x\ + &5X1X2 
+ 66^1^3 + b 7 xl + b 8 x 2 x 3 + 69X3, 

^3 =Co + C1X1 + C 2 X 2 + C3X3 + C4X1 + C5X1X2 
+ C 6 XiX 3 + C7X2 + C 8 X 2 X 3 + C9X3. 
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(4) 



Correspondingly, if the transformations that connect systems (J3D and ([2]) exist, they will 
also be complex. It was suggested in [34j, [35[ to use the ansatz library that permits to obtain 
various versions of the OS from relations between the coefficients of the OS and the SS. 

Sometimes, it may happen that a model for complex processes, including chaotic pro- 
cesses, can have a rather simple form. Although the general system (j3J) contains 18 nonlinear 
terms, the Lorenz system 11], for example, contains only 2 such terms, 



x x = -a{xi - x 2 ), 

±2 = —X1X3 - x 2 + px x , 

x 3 = -/3x 3 + xxx 2 , 



(5) 



where a, p, j3 are constant parameters. The Rossler system [36 



X\ — —X2 — X3, 
X2 = Xi + ax 2 , 

X 3 = b-CX 3 + X!X 3 , 



(6) 



where a, b, c are parameters, has even simpler form. System has only one nonlinear term 
which is a product of two different variables. As opposed to the general form of system (j3J), 
systems fl^D and ([6]) do not contain squares of the variables. Having this in mind, one can 
consider replacing the general type system (j3J) with a simplified system of the form 



a + aiXi + a 2 x 2 + a 3 x 3 , 
bo + b x xi + b 2 x 2 + b 3 x 3 , 

C + C\X\ + C 2 X 2 + C 3 X 3 + C A X\X 2 + C5X1X3 + c e x 2 x 3 . 



(7) 



Definition 1. We say that a system belongs to the Rossler class (R-class) if it is of the 
form ([7]) and only one of the coefficients 04,05, Cq is distinct from zero. 

Choose the variable x 2 to be the observable in the Rossler system, that is, y\ = x 2 . Its 
reconstruction, by 32|, can be obtained in the form 



where A 



o- 



yi =2/2, 
2/2 =2/3 

y 3 =A + Atyi + A 2 y 2 + A 3 y 3 + A±y\ + A 5 y x y 2 + A§yiy 3 
+ A 7 y\ + A s y 2 y 3 + Agyj, 



(8) 



A 9 are constants with 



It is easy to show that relation 
a more general type. 



A 9 = 0. (9) 
holds not only for the Rossler system but for systems of 
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Definition 2. We say that a system belongs to a shortened Rossler class (572-class), if it is 
of the i?-class and 63 = 0, that is, a general S"i?-system is of the form 



a + aixi + a 2 x 2 + a 3 x 3 , 
bo + hxi + b 2 x 2 , 

C + C\X\ + C 2 X 2 + C 3 X 3 + C4X1X2 + C5X1X3 + c e x 2 x 3 . 



(10) 



Proposition 1. If the OS has form / fTTJj) . then its reconstruction to a SS will have the form 



V\ =1/2, 

h =V3, 

y 3 =A + A x y\ + A 2 y 2 + A 3 y 3 + A±y\ + A 5 y x y 2 + A & y x y 3 
+ A 7 yl + A s y 2 y 3 

and the relations between the coefficients in systems IfTty) and 07]) is given by 



A =a 3 
A\ =a 3 



C Ci 

bo h 

h b 2 
ci c 2 
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b h 
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A proof of Proposition [TJ is given in Appendix A 



'ir 



(12) 



Hence, one can infer that if the reconstruction of the unknown OS from one observable 
is of form ffTTj) . then the OS can be of the SR-class. This fact can be used in the analytical 
search for the form of the OS, replacing the calculation procedure. 
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The Rossler system ([6]), with the notations as in (ITU]) , can be represented as 

x 1 = a 2 x 2 + a 3 x 3 , 

x 2 = hxi + b 2 x 2l (13) 

X 3 = C + C3X3 + C 5 XiX 3 , 

where a 2 = —1, 03 = —1, b\ = 1, b 2 = a, Co = b, C3 = — c, C5 = 1. Since a = a± = bo = c± = 
c 2 = c 4 = c 6 = in this case, the expressions in (jT2l) for the Rossler system become 

a-shco = -b, A 1 = -a 2 b x c 3 = -c, 

a 2 bt - b 2 c 3 = -1 + ac, A 3 = b 2 + c 3 = a - c, , ^ 

a 2 b 2 c 5 = -a, A 5 = c 5 (6|/&! - a 2 ) = a 2 + 1, 

A 7 = -62C5/&1 = -a, A 8 = C5/61 = 1. 

Using relations f|T4|) one can obtain systems of type fTTTjl that would have the solution yi(t) 
coinciding with a solution x 2 {t) of the original Rossler system. 

Let us state an obvious general result that we will use in the following. 

Proposition 2. If two different OS's have the same solution considered as the observable 
Ui{t), then the SS reconstructed from this observable will be the same for both OS's. 

3. Results 

3.1. Analogs of the Rossler system 

Using Proposition |5] and relations (TH|) one can obtain different versions of the OS, which 
would have the same structure, that is, the nonzero coefficients in the right-hand sides will 
be the same as in the Rossler system. The values of the coefficients of the new system will 
differ from those in the Rossler system but the function x 2 (t) will coincide with the function 
x 2 (t) in the Rossler system. 

As an example, consider a reconstruction of the Rossler system for a = 0.15, b = 0.2, 
c = 10. The functions xi(t), x 2 (t), x 3 (t), x 2 (xi) are presented for this case in Fig. [TJ For 
system ([TBI , we get a 2 = a 3 = — 1, 61 = l,b 2 = 0.15, Co = 0.2, c 3 = — 10, C5 = 1. By f|T4l) . 
A = a 3 b\Co. If, for example, 61 is unchanged, and the coefficient Co is increased by 10 times, 
then for A to be unchanged, the absolute value of a 3 must be reduced also by 10 times. 
New values of the coefficients will be Cq = 2, a 3 = —0.1. Since these changes do not change 
the value of A and the coefficients A 1 , . . . .A 8 do not depend on c and a 3 , hence remain 
unchanged, Proposition [2] can be applied. Hence, the solution x 2 (t) of the new OS must 
coincide with x 2 (t) of the original Rossler system. This is illustrated in Fig. [2j The graphs 
show that the functions Xi(t) and x 2 (t) remain unchanged, see Fig. [lj and, for the function 



x 3 , the scale has changed. The scaling problem in more detail has been considered in [33 . 

Using relations (1121) it is also possible to obtain a modification of the Rossler system with 
a change of the structure, for example, like the following: 

±1 = a 2 x 2 + a 3 x 3 , 

x 2 = b + biXx + b 2 x 2 , (15) 

X 3 =C + 05X1X3. 
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Figure 1: The functions xi(t), X2(t), X3 (t), £2(^1) in the original Rossler system (fT3| . Numeric integration 
is carried out with the fourth-order Runge-Kutta method on the time interval of 50 sec. with step 0.005 sec. 



Comparing systems (JT5j) and ffl~3]) . one can see that in system (jl5|) c 3 = but b ^ 0. Then, 
for system ([Pol) , we get from f TTZj) that 



A = a 3 6ic , Ai = a 2 &oC 5 , 

A 2 = a 2 h + b b 2 c 5 /b u A 3 = b 2 - 6oe 5 /&i, 

A 4 = a 2 b 2 c 5 , A 5 = cs{bl/bi - a 2 ) 

A 6 = A 7 = -b 2 c 5 /bx, A 8 = C5/61. 



(16) 



The analysis given in |Appendix B| shows that by setting bo = c and leaving a 2 , 03, 61, 



&2, Co, C5 as in system (Tl3|) . the values of the coefficients in the reconstruction ( fl6|) will be 
the same as the coefficients in the reconstruction (THj) . Consequently, system (Tl5|) satisfies 
the conditions in Proposition [2J Hence the solution x 2 (t) of system f )15p will coincide with 
the solution x 2 (t) of system ( 1T5]) for an appropriate choice of the initial conditions. This is 
illustrated in Fig. [31 where one can also see that the function xs(t) coincides with that for 
the Rossler system, and x\(t) is shifted as compared with x\(t) for system ( 113]) . 



3.2. Finding the OS from its reconstruction in the form of a SS 

In some cases, the proposed approach could be effective when recovering an unknown 
model from its reconstruction f TiT]) . As an example, consider the system 

±1 = a 2 x 2 + a 3 x 3 , 

x 2 = b 1 x 1 , (17) 

A3 = C1X1 + C3X3 + C4X1X2, 
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Figure 2: The same as in Fig. [T]for the Rossler system with the values of cq and a 3 changed. 



where a 2 = —25.4, 03 — l,b\ — l,ci = 15.4, c 3 = — 10, C4 = —143. This and all subsequent 
systems were solved by applying the fourth-order Runge-Kutta method on the time interval 
of 25 sec. with step 0.001 sec. The obtained time series for x 2 (t) in system f|T7|) was taken 
to be a unique observable, that is, we took yi(t) = x 2 {t) for the reconstruction in the form 
of the SS. The reconstructed SS of the form ffTTl) has the coefficients shown in Table [TJ The 



reconstruction was obtained by applying both a numerical method, similar to 29], and an 
analytical method using relations ( IT2|) . As Table [1] shows, the errors in the values of the 
coefficients in the reconstruction obtained numerically are small. In the following, when 
making necessary transformations we used exact values obtained analytically and shown in 
the right column of the table. As a result, the SS has the form 



V\ = 2/2, 
m = V3, 

y 3 = A x y x + A 2 y 2 + A 3 y 3 + A h y x y 2 , 



18) 



where A\ = —254, A 2 = —10, A 3 = —10, A 5 = —143. Solutions of system ( TT8[) and its phase 
portraits are shown in Fig. HI 

We will consider the OS fTT7|) to be unknown. To obtain information about it, we use ( ITS]) 



and f lTH]) . The results of the analysis given in Appendix C show that the sought OS has 
&o = b 2 = Cq = C5 = Cq = and the nonzero coefficients could only be the following: 
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Figure 3: The same as in Fig. [T] for system (fT5j). 
a-h a 2> a 3j fro, b\, C\, c 2 , C3, C4. This significantly simplifies system f lT2|) giving 



'4> 


= ai6 c 3 - a 3 6 ci, 




= «Ac 2 - a 2 6ic 3 - a 3 b c 4 , 


A 2 


= a 2 bi + a 3 ci - aic 3 , 




= «i + c 3 , 




— a 3 C4 ; 




= A 6 = A 7 = A 8 = 0. 



(19) 



To pass to the reconstruction of the OS, it is necessary to determine how many of the 
9 nonzero coefficients will be contained in the sought equations and which of them. As a 
simplest version of the OS, one can take the following system that has the same structure 
as system (jT8{) : 

x x = a 3 x 3 , 

x 2 = hxx, (20) 

i 3 = C\Xi + C 2 X 2 + C 3 X 3 + C4X1X2. 

The quantities in systems ( ITS]) and ( 1211 are connected with the relation x 2 = yi, a 3 = 1, 
61 = 1, ci = A 2 , c 2 = Ai, c 3 = A 3 , c 4 = A 5 . 

It is clear that system (1201) is not the only possible one for the OS recovered from the 
SS (|T8l) . Denote by K the total number of nonzero coefficients in the right-hand sides of 
the OS. We assume, similarly to ( 120|) . that K = 6 for other unknown OS's (the case where 
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Tabic 1: Values of the coefficients in reconstruction (fTTj) for the solution x% (t) of the OS (fTT|) obtained 
numerically and analytically using relation (IT^I) . The value of the coefficient Ag obtained by numerical 
calculations verifies relation 



K ^ 6 will be considered in Section |33|) . Since relations (ITU]) involve 9 coefficients, when 
considering candidate systems [37| to choose a unique real OS from, it is necessary to check 
relations ( II 9p for possible combinations of 6 coefficients from 9 as to satisfy conditions in 
Proposition [2] To this end, it is sufficient to alternatively set 3 out of 9 coefficients to zero 
and check whether the structure of the SS is that of (fl~8l) . Such transformations are carried 
out in|Appendix C| As the result we get the OS's S\ - S 8 , see Table [2j 



The functions x%{t) for all systems Si - Sg are practically coincide with the time series 
for yi(t) used in the reconstruction, see Fig. [H Insignificant differences are due to numerical 
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Figure 4: The functions and phase portraits for system (TT5)) ; yi(t) is the observable X2(t) in system (flT)) . 

integration errors and rounding the fractional values of the coefficients obtained from f[T9"j) 
for some OS's. The phase curves for systems S2 - S$ are shown in Fig. [5j The phase 
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Table 2: OS's corresponding to reconstruction (fT5]l : K is the number of the nonzero coefficients in the 
right-hand sides of the OS's. System (fT7| is denoted by S3, system (|20l) by Si, and system (|24|) by Si 7. 

trajectories of system Si are similar to the trajectories of system ( Fl8|) . Relations for the 
coefficients for the SS and all OS's obtained from fTl9|) are shown in Table [3j 

3. 3. Determining a complete family of candidate systems 

In the previous section, we have considered 8 possible OS's that have 6 coefficients in 
the right-hand sides. Using relation f JT9|) one can find the number K of possible nonzero 
coefficients in the OS that has system ffl8|) as a SS. First, let us find a lower bound for K, 
denoted by K min . 

Definition 3. An OS will be called minimal for the SS f JT8|) if it permits a reconstruction 
in the form of (fT8"|) and has K min nonzero coefficients, and any system of the form ffTU]) with 
K < -Kmin can not give a reconstruction in the form of ffTS]) . 

Let us check whether systems S\ - S$ are minimal, that is, whether there exists an OS 
with K < 6. To do this, it is necessary to equate various coefficients in these systems to 
zero, but the coefficients A±, A 2 , A 3 , A 5 in the SS should be distinct from zero. It turned out 
that there is a unique system with K = 5 that satisfies this condition, 

±i = a 2 x 2 + a 3 x 3 , 

x 2 = hx 1 , (21) 

X 3 = C3X3 + C4X1X2. 
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a 3 c 4 



Table 3: Relations between the coefficients of the SS ([T5]) and OS's corresponding to (fTT)|) . 



Here, by (USD, 

A a = -a 2 b x c 3 , A 2 = a 2 6i, A 3 = c 3 , A 5 = a 3 c 4 . 
Although Ax, A 2 ,A 3 , A 5 are nonzero, it follows from (122 p that 

A x = -A 2 A 3 . 



(22) 



(23) 



By substituting the values of A X ,A 2 ,A 3 from Table [T] into fl23]), we see that (l2~3"j) is not 
true. Consequently, relations f )22|) do not permit to obtain a reconstruction of ffT8~]) . and 
system ( 121]) can not be an OS. So, the minimal OS's could only be those with K = 6 in 
Table H 



The analysis in Appendix C shows that the maximal value of K so that the correspond- 
ing OS is reconstructed from ( JT8"j) is i^ max = 9. That is, a maximal OS will contain all the 
coefficients that enter the right-hand sides of relations ( TT9|) . It has the form 



±i = diXi + a 2 x 2 + a 3 x 3 , 
x 2 = b + 61X1, 

X 3 = C1X1 + c 2 x 2 + c 3 x 3 + c 4 x 1 x 2 . 



(24) 



Since K = 9 for this system and the number of known coefficients in the SS ([TBI is 4, some 
values for the coefficients ai, . . . , c 4 were taken arbitrarily (a 3 = 61 = 1) whereas the others 
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were determined from (|T9l) . As the result we get a± = —5, a 2 = —10, bo = —1, c\ = 25, 
C2 = —61, C3 = —5, C4 = —143. 

Now, to find all possible OS's other than with K m[n = 6 and K mSuX = 9, consider pos- 
sible OS's with K = 7 and K = 8. We can previously estimate the possible number of 
OS's for each value of K. Three of the coefficients, 03, b\, and C4, are always nonzero 
(see Appendix C), whereas the other 6 may or may not be zero. If K = 8, the system must 
have 5 more nonzero coefficients. Various cases can be obtained by in turn equating one of 
the six unknown coefficients to zero. The number of such combinations will be n§ = (J = 6. 
Similarly, if K = 7, we get n 7 = (®) = 15, and for K = 6, = Q = 20. Each combination 
of zero and nonzero coefficients must be checked with relations fll9p . If the reconstruction of 
an OS of the form f)18p is impossible for some combination of the coefficients, then this com- 



bination is rejected. Such an analysis has been carried out in Section 13.21 and |Appendix C 
for K = 6. As is indicated, see Table El the number of possible OS's in this case is 8 which 
is much less than n$ = 20. 

A similar analysis has been done for K = 7 and K = 8. The results are shown in Tables |2] 
and EJ Hence, the total number of possible OS's is 17. 

3.4- Choosing an OS from candidate systems 

In order to choose an OS from candidate systems given in Table [2j one can use an 
additional information about the system. For example, if we know that the variable X\ 
depends on x 2 or X3, then the OS must contain the coefficients or a 3 , correspondingly. If 
we know that the change of the variable X3 depends on its value, then the OS must have 
the coefficient C3, etc. In other words, we need to find features of the OS that single it out 
from other candidate systems. Systems with no such features should be excluded from the 
consideration. 

There can arise situations where additional information regarding the OS is not sufficient 
or is missing at all. The missing features of the OS can be obtained in additional experiments 
if the conditions of the experiment allow for a change of the parameters, i.e., the coefficients 
of the OS. Namely, if the conditions of the experiment change at least one of the coefficients 
of the OS, then the observable y\{t) = X2{t) will change. The reconstruction in form (18) 
obtained from this observable will have the value of at least one of the coefficients Ai, . . . ,A$ 
changed. By analyzing these changes, one can formulate new features of the sought OS. 

The study can be carried out along the following scheme, see Fig. [61 



u 2 



ai, a 2 , a 3 , 
bo,bi, 

Cl, C2, C3, C4 



-> A, 
■> A 2 
->A 3 



Figure 6: The scheme for determining the structure of the OS. 
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1. With some process conditions (un, u m i), we get a time series yu(t) for the ob- 
servable 2/1 (t) that is used for the reconstruction of type (Tl8|) with some coefficients 

4,4,4,4. 

2. For new process conditions (ui 2 , ■ ■ ■ , u m2 ) we get a new time series yi 2 {t) and new 
reconstruction of type (fTSl) with new coefficients A u , A 22 , A 32 , A 52 . 

3. Repeat step 2 by trying to change other parameters if the experiment conditions permit 
to do so. For example, if step 2 has been performed with the process temperature 
changes, then we repeat it with the pressure changes, etc. 

4. By performing step 3 with various process conditions, we determine which of the 
coefficients in the SS change. 

5. Using the results of the experiments we formulate features for choosing the initial 
system. 

For making the analysis easier, one can use Table H] obtained from Table El It clearly 
shows which of the coefficients of various OS's determine the values of the coefficients in 
the SS. For example, according to Table HI if only the coefficient A\ is changed under some 
actions in the SS ffT8l) . this could have occurred due to a change of bo or b\ or c 2 . And if 
a coefficient of the OS changes, this means that this coefficient is not zero. Consequently, 
bo or b\ 7^ or c 2 in the OS. Similarly, if only A 2 in the reconstructed system is 
changed when different actions were applied, then this would mean that a 2 ^ or c\ ^ in 
the OS. If only A 3 in the SS is changing, then one can assume that either a\ ^ or c 3 7^ 
in the OS. 

It is also convenient for making the analysis to use Table obtained from Table SJ It 
shows which coefficients in the SS may change when different actions are applied to the 
OS. The information about the change of the coefficients of the OS is not used in this 
case. When constructing Table El various cases that may occur when external effects are 
applied to the OS were considered. For example, if the coefficient A\ changes when using 
reconstruction ffl8|) from the observable in system 5*2, then, according to Table HI this can 
occur if one of the coefficients of the OS changes, namely the coefficient c 2 . If system Si is 
considered, a change of A\ can only occur if b\ or c 2 change in the OS. All these cases are 
reflected in Table |5j 

A similar approach is used for combinations of A's. For example, if system S 2 is re- 
constructed, then simultaneous change of the coefficients Ai and A 3 is possible if the only 
coefficient c 3 in the OS is changed. But when reconstructing system S 7 , a change of A 3 can 
occur if ai is changed, whereas changes Ai if so does c 2 . But if a change of the conditions of 
the experiment implies simultaneous change of a± and c 2 in the OS, that would imply that 
both Ai and A3 change. 

Also, it is impossible for system S\ 2 that a change of only one of the coefficients in the OS 
would cause simultaneous change of the coefficients Ai, A 2 , A 5 in the SS (and A 3 remains 
the same). But a change of a 2 would imply changes of Ai and A 2 , and a change of a 3 would 
imply the same for A\ and A^. If this occurs for the same external effect, we get a number 
of changed coefficients Ai, A 2 , A 5 , which is indicated in Table |5j 
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Combinations given in Table |5]can be used as features for choosing the OS. For example, 
if the SS shows a change of only coefficient A 2 , then, according to Table EJ this can happen 
only if the OS's Si, S3, S5, S7, S9, Sn, S13, S14, S15, S\q, and Sn are considered, and this 
can not happen for the OS's S 2 , S 4 , S 6 , S 8 , Si , Si 2 . An example of choosing the OS is 
given in 



Appendix D 



OS 


Coefficients of OS 




a 2 


a 3 


bo 


61 


Cx 


c 2 


c 3 


c 4 


Si 


— 


— 


A U A 2 ,A 5 




A, 


A 2 


Ax 


^3 


A 5 


s 2 


— 


Ai,A 2 


A t ,A 5 


— 


A X ,A 2 


— 


Ax 


Ax,A 3 


A, 


S3 


— 


A U A 2 


A 2 ,A 5 


— 


A U A 2 


A 2 


— 


Ax,A 3 


A 5 


s 4 


A 2 ,A 3 




A U A 5 




Ax 




Ax 


A 2 ,A 3 


A 5 


s 5 


A 3 




A U A 2 ,A 5 




Ax 


A 2 


Ax 




A 5 


s$ 


A 2 ,A 3 


A U A 2 


A 5 




Ax,A 2 






Ax,A 2 ,A 3 


A 5 


s 7 


A 3 


A 2 


Ax,A 5 




Ax,A 2 




Ax 




A 5 


s 8 




Ai,A 2 


Ax,A 5 




Ax,A 2 






Ax,A 3 


A 5 


S9 




Ai,A 2 


A U A 2 ,A 5 




Ax,A 2 


A 2 


Ax 


Ax,A 3 


A 5 


S10 




Ai,A 2 


A U A 5 


Ax 


A U A 2 




Ax 


Ax,A 3 


Ax,A 5 


Sn 


A 2 ,A 3 




A h A 2 ,A 5 




Ax 


A 2 


Ax 


A 2 ,A 3 


A 5 


S12 


A 2 ,A 3 


Ax,A 2 


A U A 5 




Ax,A 2 




Ax 


Ax,A 2 ,A 3 


A, 


S13 


A 2 ,A 3 


A U A 2 


A 2 ,A 5 




Ax,A 2 


A 2 




^1,^2,^3 


A, 


S14 


A 3 


A 2 


A U A 2 ,A 5 




Ax,A 2 


A 2 


Ax 




A, 


S15 


A 3 


A 2 


At,A 5 


A l 


Ax,A 2 




Ax 




Ax,A 5 


Sl6 


A 2 ,A 3 


Ai, A 2 


A 1 ,A 2 ,A 5 




Ax,A 2 


A 2 


Ax 


Ax,A 2 ,A 3 


A 5 


S17 


A 2) A 3 


A U A 2 


A U A 2 ,A 5 


Ax 


Ax,A 2 


A 2 


Ax 


Ax,A 2 ,A 3 


Ax,A 5 



Table 4: The connections between the coefficients of the SS's and the OS's according to Table [3] 



4. Conclusions 

The problem of reconstructing an original system, in general, is very complex and is 
solved in present primarily using numerical methods. At the same time, an analytic approach 
may be effective in particular cases. This paper shows a relative rigor of this approach if 
applied to SR-class systems. The method can also be applied to other classes of systems if 
there are transformations that connect the standard and the original systems. 

This approach allows not only to obtain new systems that make an alternative to the 
known ones, as shown with an example of the Rossler system, but also to establish a set 
of candidate systems used to choose a unique real original system. Naturally, to solve 
the latter problem, a use of one observable is not sufficient. One also needs additional 
information about the system or a possibility to interact with the system in order to obtain 
such information. If the obtained information permits, we can determine not only the 
structure of the sought original system but also relations between its coefficients. 
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x 


A? 

^3 
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x 
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x 
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Ac 


x 


x 


x 


x 


x 


x 


x 


x 


x 




x 


x 


x 


x 




x 




4, /In 


x 


x 


x 




x 


x 


x 


x 


x 


x 


x 


x 


x 


x 


x 


x 


x 


^1; ^3 


x 


x 


x 




x 




x 


x 


x 


x 








x 


x 






At Ar 


X 


X 




X 


X 




X 


X 


X 


X 


X 


X 




X 


X 


X 


X 
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X 






X 


X 


X 
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X 


X 


X 


X 


X 


X 
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X 




X 




X 




X 




X 




X 


X 




X 
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X 








X 




X 














X 








At,A 2 ,A 3 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


A U A 2 ,A 5 


X 


X 


X 




X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


A U A 3 ,A 5 


X 


X 


X 




X 




X 


X 


X 


X 








X 


X 






A 2 ,A 3 ,A 5 


X 






X 


X 


X 


X 








X 


X 


X 


X 




X 






X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 


X 



Table 5: Combinations of coefficients of the SS, which can change while the OS undergoes external effects. 
Appendix A. 

To prove Proposition [Q let us find a relation between the variables in systems flTUJ) 
and (fTTj). 

Since y\ — X2, the second equation in (ITOi) can be written as 



whence, 



yi = b + 61X1 + 622/1, 
Vi ~ b 2 yi - b 



By differentiating (1A. 1 1) with respect to t we get 

y\ = b 1 x 1 + b 2 yx. 



(A.l) 
(A2) 

(A3) 



Substituting the expressions for X\ and i)\ = X2 from (TlO|) into (1A.3|) and making simplifica- 
tions we get 



y\ = a 6i + b b 2 + (ai&i + b^Xi + (^h + bl)x 2 + a 3 bix 3 . 
Substitute now x\ from (IA.2[) into (IA.4[) to find 

y\ - (ai + 62)2/1 + {aib 2 - a 2 b 1 )y 1 + ai& - aoh 



x 3 



a 3 bi 
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(A.4) 



(A.5) 



Differentiating (]A.4j) with respect to t we get 



V i = (ai&i + b 1 b 2 )x 1 + (a 2 bi + b\)x 2 + «3&ii3- 
After making necessary substitutions from (flOi) we find 

y 1 =(ai&i + 6i6 2 ) (a + aiXi + a 2 ^2 + a 3 x 3 ) + (a 2 &i + ^2)^2 

+ a 3 6i(c + C1X1 + c 2 x 2 + C3X3 + C4X1X2 + C5X1X3 + C6X2X3) 



(A.6) 



Replace X\ and x 3 in (1A.6I) using f]A.2|) and f]A.5[) . correspondingly, and x 2 with By 
grouping similar terms, we get 

y\ = A + A lVl + A 2 y x + A 3 y\ + A 4 yj + A 5 y lVl + A 6 y lV \ + A 7 y\ + A s y iy \, 

where the coefficients A , . . . , A s are given in system ( 1T2"]) . Setting ?/! = y 2 and ?/i = y 3 we 
get system ( 1TT|) . The proposition is proved. 

Appendix B. 

Comparing relations ( FT4"]) and ( ]T6j) we find that the expressions for A Q , A4, A 5 , A 6 , A 7 , 
A 8 in these cases coincide and those for Ai,A 2 ,A 3 differ. To find b in system f lTB]) . we 
set a^ 3 = al 5 = a 2 , a\ 3 = a\ 5 = a 3 , b\ 3 = b{ 5 = bi, bf = bf = b 2 , cj 3 = cj 5 = c , 
C5 3 = = C5, where the upper indices indicate whether the coefficients enter system ( TT3|) 
or ( TT5|) . respectively. The new coefficient 6q 5 is found, for example, by equating the relations 
for A 3 in pi]) and (1TB]). Then + c£ 3 = - 6j 5 4 5 /6f . Since 6^ 3 = 6^ 5 , we have that 
6q 5 = — c| 3 &i/cs. It follows from ( TT3|) that the numerical value of the new coefficient will be 
6j 5 = c. Substituting the relation for into the expression for Ai and A 2 from ( lltjp we 
get Ax = — a 2 bicl 3 and A 2 = a 2 b\ — b 2 c\ 3 , that are similar to the expressions for Ai and 
A 2 in f jT4"j) . Consequently, numerical values of all the coefficients in the reconstructions of 
systems (fT3j) and f lT5|) coincide and, hence, system ffT6]) meets the conditions in Proposition [2j 

Appendix C. 

Let us analyze expression ( JT2"j) by comparing f lTT]) with ( TTgj) . Since v4 8 = in f[T8"j) . we 

have 

c 5 = (C.l) 



in the OS by ([12]) . Consequently, A-? = 0, which is verified by the reconstruction (118]) . It 
also follows from (IC.ip that A 6 = c 6 . But v4 6 = in ( jTBj) and, consequently, 

c 6 = 0. (C.2) 

Since A 5 ^ but ( ICTTj) and (1CT2]) hold, we have 

a 3 7^ 0, c 4 + 0. (C.3) 
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Because A 4 = 0, it follows from (IHljl . flCl2|) . and f lC3j) that 

62 = 0. (C.4) 

Consequently, 

61 ^ 0, (C.5) 

for, otherwise, the second equation in ([TO]) splits from the other equations. 
In view of flCTTD . flU^D . and flU^j) . system (HDD becomes 

ii = «o + aiXi + a 2 x 2 + (I3X3, 
X2 = b + hxi, 

X3 = Co + C1X1 + C 2 X 2 + C3X3 + C4X1X2. 

Let us find the coordinates x w , x 20 , £30 of the equilibrium position of the system by setting 
Xi,x 2 , x 3 to zero, 

a + ai^io + a 2 x 20 + 03^30 = 0, 

b + 61x10 = 0, (C.6) 
Co + C1X10 + c 2 a;2o + c 3 a;3o + c^io^o = 0. 

Since the observable yi(t) = x 2 (t) oscillates about zero, see Fig. HI we have x 20 = in (IC.6I) . 
Then the system becomes 

a + a x XiQ + a 3 x 30 = 0, 

60 + hx 10 = 0, (C.7) 

C + C1X10 + C3X30 = 0. 

The second equation in flC.7j) gives 

xio = (C.8) 

Ol 

Substituting ( 1C.8|) into the first and the third equations in (1C.7I) we get 

aibo/bi - a 



X30 
X30 



a 3 

cibo/h - c 



(C.9) 



c 3 

By equating the right-hand sides of (1C.9j) . we have 

ai&o - a &i _ cib - cpbi 
03 c 3 



(CIO) 



We have assumed, see Section 13.41 that the values of the coefficients of the OS may change 
in an arbitrary way if the system undergoes different effects, but relation (IC.lOj) must always 
hold. This permits us to make the following conclusions. 
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1. The expressions in the left- and the right-hand sides of (IC.lOj) must be equal to zero. 



Otherwise, the relation could change if the coefficients entering this relation change. 
Consequently, 

aib — a bi = Cib — c &i = 0. (C.ll) 
2. Moreover, (IC.10I) could fail to hold if the coefficients of the OS change in the case 



where some of the four terms in (Id Op or (10. 1 1 [) are distinct from zero. Hence, the 
following must be true: 

aibo = a bi = cib = co&i = 0. (C.12) 

Note that A = in system (TT9I) as follows from (1C12j) . which is needed for the SS to be of 
the form (jlgjl . 

For (IC.f 2p (and (10. f f h ) to hold, it is sufficient that each of the monomials would have 
at least one coefficient zero. By (1C.5I) . this implies that 

a = c = 0. (C.13) 

Moreover, at least one of the two following conditions must be satisfied: 

b = (C.14) 

or 

ai = ci = 0. (C.15) 

So, by now we have that all candidate systems must have a = b 2 = c = c 5 = c 6 = 
and a 3 ^ 0, b\ ^ 0, c 4 ^ 0. The other coefficients that enter the right-hand sides of 
equations (1191) . ai, a 2 , b , ci, c 2 , c 3 may or may not be equal to zero in different versions of 
the OS. 

Using (1UTT|) we get from (j(l9j) and flCHUl) that 



x 30 = 0. (C.16) 
Substituting (lCTT3|) and flCTTB]) into (lCl7j) we get 




0, 

0, (C.17) 
0. 



If (1C.14I) holds, since b\ ^ 0, the second equation in (1C.17j) gives that xio = 0. If (1C.15j) 
holds and b ^ 0, then Xio = —bo/bi. 

Let us analyze the cases of (1C 14[) and (10. 15[) . 

1. If b = 0, then a = b = b 2 = c = c 5 = c 6 = and the candidate systems can contain 
8 nonzero coefficients ai, a 2 , a^, bi, C\, c 2 , C3, C4 where 03, 61, C4 are always nonzero. Since 
the candidate systems have 6 nonzero coefficients in the right-hand sides, all possible 
combinations of 3 more coefficients out of the remaining 5 coefficients a 2 , Ci, c 2 , C3 
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should be considered in view of Proposition 2. If two of them are zero, then the 
remaining three coefficients, together with 03, bi, C4, will determine the structure of the 
candidate system. If we substitute the zero coefficients into system (fl9|) . we obtain 
one of the systems Si - S 7 given in Table [2j A system with a± = a 3 = has been 
excluded from possible OS's, since A 3 = in this case, which contradicts the SS (ITS]) . 
Systems with a 2 = c 2 = or with c 2 = c 3 = should also be disregarded, since that 
would give A\ = 0. 

2. If b 7^ and a% — C\ — 0, we get a = ai = b 2 = Co = c\ = c§ = cq = 0, 
a 3 7^ 0,b 7^ 0,6i 7^ 0, c 4 7^ 0. Since the OS must have 6 nonzero coefficients, the 
remaining two must be chosen from 02,02,03. Set one of them to be zero each time 
and enter the others into the OS. It turns out that for a 2 = 0, A 2 = by f[T$j) . and if 
c 3 = 0, then A3 = 0, which contradicts the form of the SS (IT8i) . If c 2 = 0, the structure 
of the SS (Tl"8]) does not change, so a system with nonzero a 2 , 03, 60, &i, C3, C4 (system Sg 
in the Table [2]) can be regarded as a candidate system. 



Appendix D. 



Let us consider an example of reconstruction of an SR-class OS from one observable in 
the case where the SS is of form 



Tl8]) . It follows from the analysis carried out in Appendix C 
that the only nonzero coefficients the OS can have are ai, a 2 , a 3 , 60, &i, ci, c 2 , C3, C4 satisfying 
relations (fT9j) . Its general form is given in fl2l]), and all possible choices for the OS are given 
in Table [2J 

Assume we know that a change of the variable X\ in the sought system does not depend 
on the value of the variable x\. In other words, the coefficient a\ in system (24) is zero. We 
will consider this fact as the first feature for choosing the OS from all candidate systems. 
As Table H] shows, systems Si, S 2 , S3, S$, Sg, Sio have this property. 

Assume that measurements of the observable were taken varying the conditions of the 
experiment and value of the only coefficient A 2 was changed in reconstruction (lisp , while 
the other coefficients A\, A3, A§ remained unchanged. We then can use this as a second 
feature to single out the sought OS from other candidates. Table [5] shows that the second 
feature is enjoyed by the systems S\, S3, S5, Sj, Sg, Sn, S13, S14, S15, S\q, S17. To make 
the analysis easier, we summarize this information in Table ID. 61 



OS 


Si 


s 2 


S3 


S4 


s 5 


Sq 


s 7 


s 8 


Sg 


Sio 


Sn 


S12 


S13 


S14 


S15 


S16 


Sir 


Features 


1 


X 


X 


X 










X 


X 


X 
















2 


X 




X 




X 




X 




X 




X 




X 


X 


X 


X 


X 



Table D.6: Distribution of features 1 and 2 in candidate systems. 

As the table shows, only systems Si, S3, and Sg possess features 1 and 2. Hence, the 
number of systems to consider is reduced from 17 to 3. System Si is excluded from the 
considerations, since it has the same structure as the SS, for otherwise the problem could 
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be considered as solved after obtaining the reconstruction ( Fl8|) . Systems S3 and Sg have, 
respectively, 6 and 7 nonzero coefficients in the right-hand side, with the coefficients 02, as, 
b\, Ci, C3, and C4 entering both systems, whereas the coefficient C2 is nonzero only in system 
Sg. If the information at hand does not allow to uniquely choose one of the systems, then it 
seems reasonable to choose a simpler system, which is S3 in this case. Let us remark that this 
system, which is the same as system (TTT|) . was considered as an example of reconstruction 
in Section [32J 
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